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Motivation / Problem Statement {The Big Picture} 
*Land a damaged airplane or, return to a safe ejection site. 


General Goals & Objectives 
Flight evaluation of neural net software. 
*Increased survivability in the presence of failures or aircraft damage. 
* Increase your boundary of a flyable airplane. 
«Increase your chances to see another day. 
*Increase your chances to continue the mission. 


Airplanes in the Past Have Landed with Major 
Failures. 


But not many! 


Our Goal is to Increase the Survivability Region 
for the Pilot without luck or high skill levels or 
when the pilot is injured. 


Flight Research Programs Not a Full List 


—F-15 (Boeing,DFRC) 
+ Flight Test in 1993 
+ Simulated Failure : Stuck, Hardover, Missing Right Stabilator 


—F-16 (Barron Associates, Inc.) 
+ Flight Test in Mid 1996 
+ Simulated Failure : Missing Left Horizontal Tail 
* Used real-time parameter identification 


—X-36 (NASA Ames, DFRC, & Boeing) 
+ Flight Test in December 1998 
* Jammed in-board elevon (15%) 
* Used Neural Networks to adapt to failure 


—F-15 (NASA Ames, DFRC, & Boeing) 
+ Flight Test 1999 - present 
¢ Pre-Trained Neural Net (PTNN) 
* Used Neural Networks to organize real time stability derivative 
corrections into a database according to flight condition 
+ Stabilator and Canard failure recovery using neural nets 
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General Neural Network 
Problem Statements 


Why Use a Neural Network? 
How much do Neural Networks help a controller? 
How much do Neural Networks cost w.r.t. compute power? 


How can we certify a Neural Network? 


Neural Networks are Universal Approximators 
Minimizes a H? norm 


They permit a nonlinear parameterization of uncertainty 
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Neural networks simulate the activity of biological neurons within 
the human body. Neural networks are implemented in an attempt to 


re-create the learning processes of the brain by recognizing ‘S 
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eral Adaptive Controller Statem 


Two Types of Adaptive controllers 
1. Direct Adaptive 
2. Indirect Adaptive 


The Direct Adaptive Controller Works on the Errors. 
* Needs a Reference Model to Generate P_err = (P_cmd-Psensor) 
¢ The Neural Network “Directly” Adapts to P_err. 
* Does not need to know the source of error. 
¢ No Aero Parameter Estimation Needed 


The Indirect Adaptive Works on Identifying the source of Error. 

* Does Not Need a Reference Model. 

« Needs to Identify the Aerodynamics that have changed! (PID) 
¢ PID is Time Consuming and may not be correct. 


NN have been intensively investigated with a dynamic inversion controller. 
Many simulation test (F-15 / C-17 / Ames advanced cab ~B-757 ...) 
One flight test with an unpiloted vehicle. (very limited X36 flight tests) 
Very mature algorithms. 

Relatively lower risk involved, compared to non-DI NN controllers. 
Guarantee Bounds using the Lyapunov Function 


NN associated with non-DI controllers are just beginning to be investigated. 
Not mature algorithms yet w.r.t. Neural Net side. 
Note : We will refer to non-DI controllers as linear controllers. 
« Linear controls = (LQR, Root Locus, etc...) 
Advantage of non-DI controllers: Legacy controllers on fleet. 
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Advantages of Direct Adaptive Neural Network Control: No Parameter Estimation Needed 


Dynamic Inversion: 1%‘ Step for our Adaptive Program 


Consider the following non-linear system: 


x=f{&%xu) xueRn 
Recast as = 


vax) 


In the Ideal case, u=fixx, vy) 


Invert to obtain: 


Controllers and Dynamic Inversion 
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Problem Statement & Background 


— The Dynamic Inversion (DI) Method for Dir axis was not “well behaved with 
failures” With or Without the Neural Networks Active. 


— Control Law Designers & Pilots were not happy with excessive beta excursions 
during pitch inputs with a stab failure. 


¢ This problem (... wiggles) was Not found for a Healthy / nominal airplane. 


Solution Path Taken 
— Tried Many DI modifications attempts. 
¢ Tasked, “How about the classics” and use a hybrid system. 
— Use DI for the Pitch & Roll axes and Beta-dot for the Yaw axis. 


— Decided on a simple beta-dot and Ny classical controller. 


assical Yaw Controller 
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Classical Yaw Controller Gains K ny & K_beta_dot are 
changed to get desired dutch roll frequency and damping. seal 
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AW are the weight calculations for the current time-step 
W are the weights from the previous time-step 
A tis the time-step (0.0125 = 80 Hz rate) 


G is the adaptation gain (or learning rate) 

U, is the from error compensation 

B are the basis functions 

L is the deadband error to stop learning when error is small. 


- Values for G & L are chosen (configurable constants) 


Roll Axis NN learning Law 
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ilures Investigat 


2 groups of failures are “common” among aircraft mishaps/crashes. 


Aerodynamic Failures (A Matrix problems / lost aero surfaces, 
bent wings) 
¢ Canard Multiplier (changes lift). 


Control Failures (B Matrix problems / jammed control surfaces) 
¢ Right stab jammed at 6.85. deg 
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Problem Statement. 


— With a failure in and Neural Nets On, are the transients smaller 
compared to the Neural Net off case. 


— The following is a representative case 
¢ Left Stab Fail (-4 deg) at 5.5 seconds 


Left Stab Fail (-4 deg) 
yp at 5.5 sec. 
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Left Stab Fail (-4 deg) 


at 5.5 sec. 
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Good tracking performance under failures. 

¢ Research Controller without NN is not to bad. 

¢ Research Controller with Neural Nets are better. 

¢ Failure Transients with Neural Nets on are smaller than without 
Neural Nets. 

Handling qualities are preserved (so-so) 


Reduction in pitch cross coupling due to roll inputs is 
accomplished. 


Hope to Flight Test Neural Network Controller October 05. 
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pural Network Ca 


1. Some Neural Networks can be very computer intensive. 
¢ Sigma-Pi Neural Network is not time intensive. 


2. How can we certify a Neural Network? 
* TBD 


Backup Sides 
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Squashing Function 


Activation functions with a bounded range are called squashing functions 


{= e-gain®x 


g(x) 7 1 + egain*®x 


Activation Function 


g(q;) is a non-linear function chosen by the neural network designer(s) 
— Examples: 


Hyperbolic tangent (tanh) Sigmoid function 
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Multiple neurons 


For 1 neuron with 3 inputs: 


7 means product 


Activation Function 
for fully connected neuron 


Activation function for one neuron is written mathematically in a 
general form as: 
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Higher order terms 


Higher order terms increase the non-linear descriptive cap 
of the individual neurons within a neural network 
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Fully connected 
Higher Order Neural Network 


Sigma-pi neural networks 


Sparsely connected higher order neural network 


— Polynomial order is restricted to a configuration sufficient to obtain the 
desired degree of accuracy 


Feed-forward networks where each layer contains higher order terms 


Input Layer Hidden Layer Output Layer 
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